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Connected Mathematics Project (CMP) 

Program Description 2 The Connected Mathematics Project (CMP) is a mathematics The curriculum uses an investigative approach, and students 

curriculum designed for students in grades 6-8. Each grade level utilize interactive problems and everyday situations to learn 
of the curriculum is a full-year program and covers numbers, math concepts, 

algebra, geometry/measurement, probability, and statistics. 



Research 3 No studies of CMP meet What Works Clearinghouse (WWC) Based on this study, the WWC considers the extent of 

evidence standards, and one study meets WWC evidence evidence for CMP to be small for math achievement, 

standards with reservations. The one study included more 
than 12,000 students from grades 6-8 in Texas. 4 

Effectiveness CMP was found to have no discernible effects on math achievement. 



Math achievement 
Rating of effectiveness No discernible effects 
Improvement index 5 Average: 0 percentile points 

1. This report has been updated to include reviews of 58 studies that have been released since 2005 or were additionally identified but published prior to 
2005. Of the additional studies, 51 were not within the scope of the protocol, and seven were within the scope of the protocol but did not meet evidence 
standards. Additionally, two studies that met standards with reservations in the previous version (Ridgway, Zawojewski, Hoover, & Lambdin, 2002; Riordan 
& Noyce, 2001) no longer meet evidence standards because the intervention and comparison groups are not shown to be equivalent at baseline. (The pro- 
tocol for the middle school math area was revised to specify that groups must be equivalent on the pretest for a quasi-experimental design, and establish- 
ing equivalence with prior cohorts is now limited to adjacent cohorts.) A complete list and disposition of all studies reviewed is provided in the references. 

2. The descriptive information for this program was obtained from a publicly available source: the program’s website (http://connectedmath.msu.edu/, 
downloaded August 2008). The WWC requests developers to review the program description sections for accuracy from their perspective. Further 
verification of the accuracy of the descriptive information for this program is beyond the scope of this review. 

3. The studies in this report were reviewed using WWC Evidence Standards, Version 1.0 (see the WWC Standards). 

4. The evidence presented in this report is based on available research. Findings and conclusions may change as new research becomes available. 

5. These numbers show the average and range of improvement indices for all findings across the studies. 
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Additional program Developer and contact 

information Developed by Michigan State University, CMP is distributed by 
Pearson Prentice Hall. Address: 145 Mt. Zion Road, P.O. Box 
2500, Lebanon, IN 46052. Email: k12cs@custhelp.com. Web: 
http://connectedmath.msu.edu/. Telephone: (800) 848-9500. 

Scope of use 

Pilot editions of CMP were used from 1991 to 1997 and from 
2000 to 2006 by approximately 390 teachers and 45,000 
students across the United States. As of September 2004, 
the program had been implemented in 2,462 school districts, 
covering all 50 states. 

Teaching 

The CMP curriculum is divided into a sequenced set of units, 
each organized around different mathematical topics. The four 



to seven lessons in a unit each contain one to five problems that 
the teacher and students explore in class. Additional problem 
sets for each lesson, called Applications, Connections, and 
Extensions, help students practice, apply, connect, and extend 
their understanding and skills. Each lesson culminates in a 
Mathematical Reflections activity. Materials include student 
units, Teacher Guides, Additional Practice and Skills Workbooks, 
Assessment Resources, and CD-ROMs for lesson planning, 
assessment, and student activities. 

Cost 

For the most recent edition of CMP, each student unit costs 
$8.85, each teacher unit costs $19.97, and the Computer Test 
Bank for Assessment and Practice CD-ROM costs $129.97. 

See the publisher website for costs of other resources. 



Research Seventy-nine studies reviewed by the WWC investigated 

the effects of CMP. One study (Schneider, 2000) is a quasi- 
experimental design that meets WWC evidence standards with 
reservations. The remaining 78 studies do not meet either WWC 
evidence standards or eligibility screens. 

Meets evidence standards with reservations 

Schneider (2000) conducted a quasi-experiment to assess the 
impact of CMP on middle school math achievement in Texas. 
Twenty-three CMP schools were matched with 25 comparison 
schools that did not implement CMP. The analysis sample 
included three cohorts, but the WWC reports the results for 
only cohorts 1 and 2 because the study did not establish 
baseline equivalence for cohort 3. The CMP intervention began 



when students were in the sixth grade. Cohort 1 consisted of 
more than 3,000 CMP students and 2,600 comparison students; 
cohort 2 consisted of more than 3,400 CMP students and 2,900 
comparison students. 

Extent of evidence 

The WWC categorizes the extent of evidence in each domain as 
small or medium to large (see the WWC Procedures and Stan- 
dards Handbook, Appendix G). The extent of evidence takes into 
account the number of studies and the total sample size across 
the studies that meet WWC evidence standards with or without 
reservations. 6 

The WWC considers the extent of evidence for CMP to be 
small for math achievement. 



6. The extent of evidence categorization was developed to tell readers how much evidence was used to determine the intervention rating, focusing on the 
number and size of studies. Additional factors associated with a related concept— external validity, such as the students’ demographics and the types 
of settings in which studies took place— are not taken into account for the categorization. Information about how the extent of evidence rating was 
determined for CMP is in Appendix A6. 
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Effectiveness 



Findings 

The WWC review of interventions for middle school math 
addresses student outcomes in the math achievement domain. 
The findings below present the authors’ estimates and WWC- 
calculated estimates of the size and the statistical significance of 
the effects of CMP on students. 7 

Math achievement 

Schneider (2000) reported negative but not statistically significant 
effects of CMP on pass rates for the math portion of the Texas 
Assessment of Academic Skills (TAAS) for cohorts 1 and 2 
separately. 8 After adjusting for differences between the CMP and 
comparison groups at baseline, the WWC determined that these 
separate effects for cohorts 1 and 2 were neither statistically 
significant nor substantively important according to WWC criteria 



(an effect size greater than 0.25 in absolute value). The WWC 
also calculated the sample-weighted average effect for cohorts 
1 and 2. 9 This average effect was neither statistically significant 
nor substantively important according to WWC criteria. 

Rating of effectiveness 

The WWC rates the effects of an intervention in a given outcome 
domain as positive, potentially positive, mixed, no discernible 
effects, potentially negative, or negative. The rating of effective- 
ness takes into account four factors: the quality of the research 
design, the statistical significance of the findings, the size of 
the difference between participants in the intervention and the 
comparison conditions, and the consistency in findings across 
studies (see the WWC Procedures and Standards Handbook, 
Appendix E). 



The WWC found CMP to have Improvement index 

no discernible effects for The WWC computes an improvement index for each individual 
math achievement finding. In addition, within each outcome domain, the WWC 

computes an average improvement index for each study and an 
average improvement index across studies (see WWC Proce- 
dures and Standards Handbook, Appendix F). The improvement 
index represents the difference between the percentile rank 
of the average student in the intervention condition and the 
percentile rank of the average student in the comparison condi- 
tion. Unlike the rating of effectiveness, the improvement index is 
entirely based on the size of the effect, regardless of the statisti- 
cal significance of the effect, the study design, or the analysis. 
The improvement index can take on values between -50 and 



+50, with positive numbers denoting favorable results for the 
intervention group. 

The average improvement index for math achievement is 
0 percentile points in the study. 

Summary 

The WWC reviewed 79 studies of CMP. One study meets WWC 
evidence standards with reservations; the remaining 78 stud- 
ies do not meet either WWC evidence standards or eligibility 
screens. Based on the one study, the WWC found no discernible 
effects on math achievement. The conclusions presented in this 
report may change as new research emerges. 



7. The level of statistical significance was reported by the study authors or, when necessary, calculated by the WWC to correct for clustering within class- 
rooms or schools and for multiple comparisons. For an explanation, see the WWC Tutorial on Mismatch. For the formulas the WWC used to calculate 
the statistical significance, see WWC Procedures and Standards Handbook, Appendix C for clustering and WWC Procedures and Standards Handbook, 
Appendix D for multiple comparisons. In the case of Schneider (2000), no corrections for clustering or multiple comparisons were needed. 

8. Schneider (2000) also included a student-level analysis of Texas Learning Index (TLI) scores, a TAAS statistic designed for comparisons between TAAS 
administrations and between grades. Because the student-level intervention and comparison groups were not shown to be equivalent at baseline, this 
analysis was not included in this WWC review. 

9. The sample-weighted average of the cohort 1 and 2 effects calculated by the WWC was used in the intervention rating and is reported in Appendix A3. 
Separate findings for cohorts 1 and 2 are reported in Appendix A4. 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



3 




References 



Meets WWC evidence standards with reservations 

Schneider, C. L. (2000). Connected Mathematics and the Texas 
Assessment of Academic Skills (Doctoral dissertation, 
University of Texas at Austin, 2000). Dissertation Abstracts 
International, 62(02), 503A. (UMI No. 3004373) 

Studies that fall outside the Middle School Math review 

protocol or do not meet WWC evidence standards 

Adams, L. M., Tung, K. K., Warfield, V. M., Knaub, K., Yong, D., & 
Mudavanhu, B. (2002). Middle school mathematics compari- 
sons for Singapore Mathematics, Connected Mathematics 
Program, and Mathematics in Context (including comparisons 
with the NCTM Principles and Standards 2000). Retrieved 
from: http://www.amath.washington.edu/~adams/full.pdf. 
University of Washington, Seattle. The study is ineligible 
for review because it does not include an outcome within a 
domain specified in the protocol. 

Adams, R. L. (2005). Standards-based accountability: Improv- 
ing achievement for all students through standards-based 
mathematics instruction (Doctoral dissertation, University 
of Southern California, 2005). Dissertation Abstracts Inter- 
national, 66(06). (UMI No. 3180485) The study is ineligible 
for review because it does not include an outcome within a 
domain specified in the protocol. 

American Association for the Advancement of Science. (1999). 
Middle grades mathematics textbooks: A benchmarks-based 
evaluation. Washington, DC: Author. The study is ineligible for 
review because it does not examine an intervention imple- 
mented in a way that falls within the scope of the review. 

Anderson, N. C. (2008). Walk the line: Making sense of y = mx +b. 
In C. E. Greenes, & R. Rubenstein (Eds.), 2008 yearbook of 
the National Council of Teachers of Mathematics, Algebra 
and algebraic thinking in school mathematics (pp. 233-246). 
Reston, VA: National Council of Teachers of Mathematics. 
The study is ineligible for review because it does not examine 
the effectiveness of an intervention. 



Asquith, P., Stephens, A., Knuth, E., & Alibali, M. (2007). Middle 
school mathematics teachers’ knowledge of students’ under- 
standing of core algebraic concepts: Equal sign and variable. 
Mathematical Thinking and Learning, 9(3), 249-272. The study 
is ineligible for review because it does not include an outcome 
within a domain specified in the protocol. 

Bay, J. M. (1999). Middle school mathematics curriculum imple- 
mentation: The dynamics of change as teachers introduce 
and use standards-based curricula (Doctoral dissertation, 
University of Missouri-Columbia, 1999). Dissertation 
Abstracts International, 60(12). The study is ineligible for 
review because it does not examine an intervention imple- 
mented in a way that falls within the scope of the review. 

Bay, J. M., Beem, J. K., Reys, R. E., Papick, I., & Barnes, D. E. 
(1999). Student reactions to standards-based mathematics 
curricula: The interplay between curriculum, teachers, and 
students. School Science and Mathematics, 99(4), 182-188. 
The study is ineligible for review because it does not include 
an outcome within a domain specified in the protocol. 

Ben-Chaim, D., Fey, J. T., Fitzgerald, W. M., Benedetto, C., & 
Miller, J. (1997a). Development of proportional reasoning in 
a problem-based middle school curriculum. University of 
Maryland, College Park. (ERIC Document Reproduction Ser- 
vice No. ED412091). The study does not meet WWC evidence 
standards because the intervention and comparison groups 
are not shown to be equivalent at baseline. 

Additional source: 

Ben-Chaim, D., Fey, J. T., Fitzgerald, W. M., Benedetto, C., & 
Miller, J. (1997b). A study of proportional reasoning among 
seventh and eighth grade students. Paper presented at 
the Annual Meeting of the American Educational Research 
Association, Chicago, IL. 

Ben-Chaim, D., Fey, J. T., Fitzgerald, W. M., Benedetto, C., & 
Miller, J. (1998). Proportional reasoning among seventh grade 
students with different curricular experiences. Educational 
Studies in Mathematics, 36(3), 247-273. The study does not 
meet WWC evidence standards because the intervention 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



References (continued) and comparison groups are not shown to be equivalent 

at baseline. 

Bennett, C. L. (2007). A curriculum project of vocabulary 

development in the Connected Math program Moving Straight 
Ahead. Unpublished master’s thesis. State University of New 
York College at Brockport. The study is ineligible for review 
because it does not include an outcome within a domain 
specified in the protocol. 

Bledsoe, A. M. (2002). Implementing the Connected Mathemat- 
ics Project'. The interaction between student rational number 
understanding and classroom mathematical practices (Doc- 
toral dissertation, University of Missouri-Columbia, 2002). 
Dissertation Abstracts International, 63(12). The study is ineli- 
gible for review because it does not examine an intervention 
implemented in a way that falls within the scope of the review. 

Bray, M. S. (2005). Achievement of eighth grade students in 
mathematics after completing three years of the Connected 
Mathematics Project. Unpublished doctoral dissertation, 
University of Tennessee, Knoxville. The study is ineligible for 
review because it does not use a comparison group. 

Cai, J., & Moyer, J. C. (2006). A conceptual framework for study- 
ing curricular effects on students’ learning: Conceptualization 
and design in the LieCal project. Poster presented at the 2006 
Annual Meeting of the International Group of Psychology of 
Mathematics Education, Prague, Czech Republic. The study 
is ineligible for review because it does not examine an inter- 
vention implemented in a way that falls within the scope of 
the review. 

Cain, J. S. (2002). An evaluation of the Connected Mathematics 
Project. Journal of Educational Research, 32(4), 224-233. 

The study does not meet WWC evidence standards because 
the intervention and comparison groups are not shown to be 
equivalent at baseline. 

Capraro, M. M., Kulm, G., & Capraro, R. M. (2005). Middle 

grades: Misconceptions in statistical thinking. School Science 
and Mathematics, 105, 165-174. The study is ineligible for 
review because it does not use a comparison group. 



Choppin, J. (2006). Studying a curriculum implementation using 
a communities of practice perspective. Paper presented at 
the 28th Annual Meeting of the North American Chapter of the 
International Group for the Psychology of Mathematics Educa- 
tion, Merida, Mexico. The study is ineligible for review because 
it is not a primary analysis of the effectiveness of an interven- 
tion, such as a meta-analysis or research literature review. 

Clarkson, L. M. C. (2001). The effects of the Connected Mathematics 
Project on middle school mathematics achievement (Doctoral 
dissertation, University of Minnesota, 2001). Dissertation Abstracts 
International, 67(12), 4709A. (UMI No. 9997642) The study does 
not meet WWC evidence standards because the measures of 
effectiveness cannot be attributed solely to the intervention— 
there was only one unit assigned to one or both conditions. 

Collins, A. M. (2002). What happens to student learning in 
mathematics when a multi-faceted, long-term professional 
development model to support standards-based curricula is 
implemented in an environment of high stakes testing? (Doc- 
toral dissertation, Boston College, 2002). Dissertation Abstracts 
International, 65(2). The study is ineligible for review because it 
is not a primary analysis of the effectiveness of an intervention, 
such as a meta-analysis or research literature review. 

Danielson, C. (2005). Walking a straight line: Introductory 

discourse on linearity in classrooms and curriculum (Doctoral 
dissertation, Michigan State University, 2005). Dissertation 
Abstracts International, 67(2). The study is ineligible for review 
because it does not examine an intervention implemented in a 
way that falls within the scope of the review. 

De Groot, C. (2000). Three female voices: The transition to high 
school mathematics from a reform middle school mathematics 
program (Doctoral dissertation, New York University, 2000). 
Dissertation Abstracts International, 67(4). The study is ineligible 
for review because it does not examine an intervention imple- 
mented in a way that falls within the scope of the review. 

Durkin, N. M. (2005). Using Connected Math Program: Its impact 
on the Delaware State Testing scores of 8th-grade students 
at Milford Middle School (Doctoral dissertation, Wilmington 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



5 




References (continued) College, 2005). Dissertation Abstracts International, 66(4). 

(UMI No. 913516241) The study is ineligible for review because 
it does not use a comparison group. 

Fauth, T. (2007). Using the Connected Math Project to improve 
seventh grade math scores at Wapato Middle School. Unpub- 
lished master’s thesis, Heritage University, Toppenish, WA. 
The study does not meet WWC evidence standards because 
the intervention and comparison groups are not shown to be 
equivalent at baseline. 

Folsom, M. L. (2002). Empowering girls in math: The influence 
of curriculum on female beliefs about mathematics (Master’s 
thesis, Pacific Lutheran University, 2002). Masters Abstracts 
International, 41(2). The study is ineligible for review because 
it does not examine an intervention implemented in a way that 
falls within the scope of the review. 

Genz, R. (2006). Determining high school students’ geometric 
understanding using van Hiele levels: Is there a difference 
between standards-based curriculum students and non- 
standards-based curriculum students? Unpublished master’s 
thesis, Brigham Young University, Provo, UT. The study is 
ineligible for review because it does not use a sample within 
the age or grade range specified in the protocol. 

Goodman, E. (2004). Connected Mathematics Project: A con- 
structivist view of mathematics education in the middle grades. 
Masters Abstracts International, 43(2). The study is ineligible 
for review because it does not examine an intervention imple- 
mented in a way that falls within the scope of the review. 

Grandau, L., & Stephens, A. C. (2006). Algebraic thinking and 
geometry. Mathematics Teaching in the Middle School, 11(7), 
344-349. The study is ineligible for review because it does not 
include an outcome within a domain specified in the protocol. 

Griffith, L., Evans, A., & Trowell, J. (2000). Arkansas grade 8 
benchmark exam: How do Connected Mathematics schools 
compare to state data? Little Rock, AR: Arkansas State 
Department of Education. The study does not meet WWC 
evidence standards because the intervention and comparison 
groups are not shown to be equivalent at baseline. 



Halat, E. (2007). Reform-based curriculum & acquisition of the 
levels. Eurasia Journal of Mathematics, Science & Technol- 
ogy Education, 3(1), 41-49. The study is ineligible for review 
because it does not examine an intervention implemented 
in a way that falls within the scope of the review. 

Herbel-Eisenmann, B. A. (2000). How discourse structures 
norms: A tale of two middle school mathematics classrooms 
(Doctoral dissertation, Michigan State University, 2000). Dis- 
sertation Abstracts International, 62(1). The study is ineligible 
for review because it does not examine an intervention imple- 
mented in a way that falls within the scope of the review. 

Hull, L. S. H. (2000). Teachers’ mathematical understanding of 
proportionality: Links to curriculum, professional develop- 
ment, and support (Doctoral dissertation, University of Texas 
at Austin, 2000). Dissertation Abstracts International, 62(2). 
The study is ineligible for review because it does not examine 
the effectiveness of an intervention. 

Izsak, A. (2008). Mathematical knowledge for teaching fraction 
multiplication. Cognition and Instruction, 26(1), 95-143. The 
study is ineligible for review because it does not include a 
student outcome. 

Izsak, A., Tillema, E., & Tunc-Pekkan, Z. (2008). Teaching 
and learning fraction addition on number lines. Journal for 
Research in Mathematics Education, 39(1), 33-62. The study 
is ineligible for review because it does not include an outcome 
within a domain specified in the protocol. 

Jansen, A. (2006). Seventh graders’ motivations for participating 
in two discussion-oriented mathematics classrooms. Elemen- 
tary School Journal, 106(5), 409-428. The study is ineligible 
for review because it does not include an outcome within a 
domain specified in the protocol. 

Katwibun, D. (2004). Middle school students’ mathematical 
dispositions in a problem-based classroom (Doctoral disser- 
tation, Oregon State University, 2004). Dissertation Abstracts 
International, 65(5). The study is ineligible for review because 
it does not examine an intervention implemented in a way that 
falls within the scope of the review. 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



6 




References (continued) Keiser, J. M. (1997). The development of students’ understanding 

of angle in a non-directive learning environment (Doctoral 
dissertation, Indiana University, 1997). Dissertation Abstracts 
International, 58(8). The study is ineligible for review because 
it does not examine an intervention implemented in a way that 
falls within the scope of the review. 

Kersaint, G. (1998). Preservice elementary teachers’ ability to 
generalize functional relationships: The impact of two versions 
of a mathematics content course (Doctoral dissertation, 

Illinois State University, 1998). Dissertation Abstracts Interna- 
tional, 59(5). The study is ineligible for review because it does 
not examine an intervention implemented in a way that falls 
within the scope of the review. 

King, D. A. (2007). A study to ascertain the effects of the Con- 
nected Mathematics Project on student achievement in the 
Buffalo public schools. Unpublished master’s thesis, State 
University of New York at Buffalo. The study does not meet 
WWC evidence standards because the intervention and com- 
parison groups are not shown to be equivalent at baseline. 

Krebs, A. S. (2003). Middle grades students’ algebraic under- 
standing in a reform curriculum. School Science and Math- 
ematics, 103(5), 233-245. The study is ineligible for review 
because it does not use a comparison group. 

Additional source: 

Krebs, A. S. (1999). Students’ algebraic understanding: A 
study of middle grades students’ ability to symbolically 
generalize functions (Doctoral dissertation, Michigan State 
University, 1999). Dissertation Abstracts International, 
60(06), 1949A. (UMI No. 9936570) 

Lambdin, D. V., & Lappan, G. (1997). Dilemmas and issues in 
curriculum reform: Reflections from the Connected Math- 
ematics Project. Paper presented at the Annual Meeting of the 
American Educational Research Association, Chicago, IL. The 
study is ineligible for review because it does not examine the 
effectiveness of an intervention. 

Lapan, R., Reys, B., Reys, R., & Holliday, G. (2001). Assessing 
the performance of middle grade students using standards- 



based mathematics instructional materials. University of 
Missouri-Columbia. The study does not meet WWC evidence 
standards because the measures of effectiveness cannot be 
attributed solely to the intervention— there was only one unit 
assigned to one or both conditions. 

Additional source: 

Lapan, R. T., Reys, B. J., Barnes, D. E., & Reys, R. E. (1998). 
Standards-based middle grade mathematics curricula: 
Impact on student achievement. Paper presented at the 
meeting of the American Educational Research Associa- 
tion, San Diego, CA. 

Lewis, R. M. (2002). Mathematics for all? The cultural relevance 
of Connected Mathematics (Master’s thesis, Pacific Lutheran 
University, 2002). Masters Abstracts International, 41(2). The 
study is ineligible for review because it does not examine the 
effectiveness of an intervention. 

Lowe, P. (2004). A new approach to math in the middle 
grades. Principal, 84(2), 34-39. The study is ineligible for 
review because it does not examine the effectiveness of 
an intervention. 

Lubienski, S. T. (2000a). A clash of social class cultures? Stu- 
dents’ experiences in a discussion-intensive seventh-grade 
mathematics classroom. Elementary School Journal, 100(4), 
377-403. The study is ineligible for review because it does not 
examine the effectiveness of an intervention. 

Lubienski, S. T. (2000b). Problem solving as a means toward 
mathematics for all: An exploratory look through a class 
lens. Journal for Research in Mathematics Education, 31(4), 
455-482. The study is ineligible for review because it does not 
examine the effectiveness of an intervention. 

Mathematics and Science Expert Panel for the U.S. Department 
of Education. (1999). Mathematics and science expert panel: 
Promising and exemplary mathematics programs, evalua- 
tion report prepared for the U.S. Department of Education. 
Washington, DC: U.S. Department of Education. The study is 
ineligible for review because it does not examine the effective- 
ness of an intervention. 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



References (continued) Mathis, E. (2004). a comparison of two NSF-funded middle 

school mathematics curricula in Delaware’s Appoquinimink 
and Caesar Rodney school districts. (Doctoral dissertation, 
Wilmington College, 2004). Dissertation Abstracts Interna- 
tional, 65(1). (UMI No. 765270181) The study does not meet 
WWC evidence standards because the measures of effective- 
ness cannot be attributed solely to the intervention— there 
was only one unit assigned to one or both conditions. 

McNeil, N., Grandau, L., Knuth, E., Alibali, M., Stephens, A., 
Hattikudur, S., et al. (2006). Middle-school students’ under- 
standing of the equal sign: The books they read can’t help. 
Cognition and Instruction, 24(3), 367. The study is ineligible 
for review because it does not include an outcome within a 
domain specified in the protocol. 

Meiler, J. (2006). Does a problem-centered curriculum foster 
positive or negative changes in students’ attitude and learning 
in mathematics?: A case study of three sixth-grade students. 
Unpublished master’s thesis, Pacific Lutheran University, 
Tacoma, WA. The study is ineligible for review because it does 
not use a comparison group. 

O’Clair, K. K. (2005). Impact on student achievement: Going to 
scale with a middle school math initiative. Unpublished doc- 
toral dissertation, University of Denver, CO. The study does 
not meet WWC evidence standards because the measures of 
effectiveness cannot be attributed solely to the intervention— 
the intervention was combined with another intervention. 

O’Neal, S. W., & Robinson-Singer, C. (2003). The Arkansas state- 
wide systemic initiative pilot of the Connected Mathematics 
Project: An evaluation report. Albuquerque, NM: Accountability 
& Development Associates, Inc. The study does not meet WWC 
evidence standards because the intervention and comparison 
groups are not shown to be equivalent at baseline. 

Post, R. A. (2004). Generation of mathematical knowledge through 
teacher practice: Study of a novice elementary teacher. Dis- 
sertation Abstracts International, 65(12). The study is ineligible 
for review because it does not examine an intervention imple- 
mented in a way that falls within the scope of the review. 



Post, T. R., Harwell, M. R., Davis, J. D., Maeda, Y., Cutler, A., 
Andersen, E., et al. (2008). “Standards”-based mathematics 
curricula and middle-grades students’ performance on 
standardized achievement tests. Journal for Research in 
Mathematics Education, 39(2), 184-212. The study is ineligible 
for review because it does not use a comparison group. 

Prentice Hall. (2006). CMP: Research and evaluation summary. 
Upper Saddle River, NJ: Author. The study is ineligible for 
review because it is not a primary analysis of the effective- 
ness of an intervention, such as a meta-analysis or research 
literature review. 

Preston, R. V., & Lambdin, D. V. (1997). Teachers changing in 
changing times: Using stages of concern to understand 
changes resulting from the use of an innovative mathematics 
curriculum. Paper presented at the Annual Meeting of the 
American Educational Research Association, Chicago, IL. 

The study is ineligible for review because it does not examine 
an intervention implemented in a way that falls within the 
scope of the review. 

Reys, R., Reys, B., Lapan, R., Holliday, G., &Wasman, D. (2003). 
Assessing the impact of standards-based middle grades 
mathematics curriculum materials on student achievement. 
Journal for Research in Mathematics Education, 34(1), 74-95. 
The study does not meet WWC evidence standards because 
the measures of effectiveness cannot be attributed solely to 
the intervention— there was only one unit assigned to one or 
both conditions. 

Additional source: 

Reys, R., Reys, B., Lapan, R., Holliday, G., &Wasman, D. 
(2004). Assessing the impact of standards-based middle 
grades mathematics curriculum materials on student 
achievement: Corrections. Journal for Research in Math- 
ematics Education, 35(2), 152. 

Richards, K. T. (2004). Communications in mathematics. Masters 
Abstracts International, 43(2). The study is ineligible for review 
because it does not examine an intervention implemented in a 
way that falls within the scope of the review. 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



8 




References (continued) Rickard, A. (1995). Teaching with problem-oriented curricula: 

A case study of middle-school mathematics instruction. 

The Journal of Experimental Education, 64(1), 5. The study is 
ineligible for review because it does not include an outcome 
within a domain specified in the protocol. 

Rickard, A. (1998). Conceptual and procedural understanding in 
middle school mathematics. In L. Leutzinger (Ed.), Mathematics 
in the middle (pp. 25-29). Reston, VA: National Council of Teach- 
ers of Mathematics. The study is ineligible for review because it 
does not examine the effectiveness of an intervention. 

Ridgway, J. E., Zawojewski, J., & Hoover, M. (2000). Problematising 
evidence-based policy and practice. Evaluation and Research 
in Education, 14( 3;4), 181-192. The study is ineligible for review 
because it does not examine the effectiveness of an intervention. 

Ridgway, J. E., Zawojewski, J. S., Hoover, M. N., & Lambdin, D. 

V. (2002). Student attainment in the Connected Mathemat- 
ics curriculum. In S. L. Senk, & D. R. Thompson (Eds.), 
Standards-based school mathematics curricula: What are 
they? What do students learn? (pp. 193-224). Mahwah, NJ: 
Lawrence Erlbaum Associates, Inc. The study does not meet 
WWC evidence standards because the intervention and com- 
parison groups are not shown to be equivalent at baseline. 
Additional source: 

Hoover, M., Zawojewski, J. S., & Ridgway, J. E. (1997). Effects 
of the Connected Mathematics Project on student attain- 
ment. Paper presented at the meeting of the American 
Educational Research Association, Chicago, IL. 

Rittle-Johnson, B., & Koedinger, K. (2005). Designing knowledge 
scaffolds to support mathematical problem solving. Cognition 
and Instruction, 23(3), 313-349. The study is ineligible for 
review because it does not use a comparison group. 

Riordan, J. E., & Noyce, P. E. (2001). The impact of two 

standards-based mathematics curricula on student achieve- 
ment in Massachusetts. Journal for Research in Mathematics 
Education, 32(4), 368-398. The study does not meet WWC 
evidence standards because the intervention and comparison 
groups are not shown to be equivalent at baseline. 



Schoenfeld, A., Burkhardt, H., Daro, P., Ridgeway, J., Schwartz, J., 
& Wilcox, S. (1999). Balanced assessment: Middle grades 
assessment. New York, NY: Dale Seymour Publications. The 
study is ineligible for review because it does not examine an 
intervention implemented in a way that falls within the scope 
of the review. 

Seifer, M. D. (2005). Collaborating with colleagues to improve 
student learning using the Connected Mathematics Project. 
Unpublished master’s thesis, Bank Street College of Educa- 
tion, New York, NY. The study is ineligible for review because 
it does not include an outcome within a domain specified in 
the protocol. 

Smith III, J. P., & Star, J. R. (2007). Expanding the notion of 
impact of K-12 standards-based mathematics and reform cal- 
culus programs. Journal for Research in Mathematics Educa- 
tion, 38(1), 3-34. The study is ineligible for review because it is 
not a primary analysis of the effectiveness of an intervention, 
such as a meta-analysis or research literature review. 

Star, J., & Hoffmann, A. (2005). Assessing the impact of stan- 
dards-based curricula: Investigating students’ epistemological 
conceptions of mathematics. The Mathematics Educator, 75(2), 
25-34. The study is ineligible for review because it does not 
include an outcome within a domain specified in the protocol. 

Star, J. R., Smith III, J. P, & Jansen, A. (2008). What students 
notice as different between reform and traditional mathemat- 
ics programs. Journal for Research in Mathematics Educa- 
tion, 39(1), 9-32. The study is ineligible for review because it 
does not examine an intervention implemented in a way that 
falls within the scope of the review. 

Stevens, B. B. A. (2005). The development of pedagogical 
content knowledge of a mathematics teaching intern: The role 
of collaboration, curriculum, and classroom context. Unpub- 
lished doctoral dissertation, University of Missouri-Columbia. 
The study is ineligible for review because it does not include 
an outcome within a domain specified in the protocol. 

Tarr, J., Chavez, 6., Appova, A., & Regis, T. (2005). Discordant 
implementation of mathematics curricula by middle school 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



9 




References (continued) mathematics teachers. Proceedings of the 27th Annual Meet- 
ing of the North American Chapter of the International Group 
for the Psychology of Mathematics Education, Roanoke, VA. 
The study is ineligible for review because it does not include 
an outcome within a domain specified in the protocol. 

Tarr, J. E., Reys, R. E., Reys, B. J., Chavez, O., Shih, J., & Oster- 
lind, S. J. (2008). The impact of middle-grades mathematics 
curricula and the classroom learning environment on student 
achievement. Journal for Research in Mathematics Education, 
39(3), 247-280. The study does not meet WWC evidence 
standards because the measures of effectiveness cannot 
be attributed solely to the intervention— the intervention was 
combined with another intervention. 

Additional source: 

Reys, R., Reys, B., Tarr, J., & Chavez, O. (2006). Assessing 
the impact of standards-based middle school mathemat- 
ics curricula on student achievement and the classroom 
learning environment. Washington, DC: National Center for 
Education Research. 

Triantos, L. M. (2005). The aftermath of implementing a standards- 
based curriculum in a K-8 district: Is there a correlation 
between hands-on instruction and math scores? Unpublished 
master’s thesis, Rowan University, Glassboro, NJ. The study is 
ineligible for review because it does not use a comparison group. 

Van Dyke, C. L. (2001). The shape of things to come: Mathemat- 
ics reform in the middle school (Master’s thesis, Pacific 
Lutheran University, 2001). Masters Abstracts International, 
40(2). The study is ineligible for review because it does not 
use a comparison group. 

Wasman, D. G. (2000). An investigation of algebraic reasoning of 
seventh- and eighth-grade students who have studied from 
the Connected Mathematics Project curriculum (Doctoral dis- 
sertation, University of Missouri-Columbia, 2000). Disserta- 
tion Abstracts International, 67(09), 3498A. (UMI No. 9988711) 
The study does not meet WWC evidence standards because 
the intervention and comparison groups are not shown to be 
equivalent at baseline. 



Winking, D. (1998). The Minneapolis Connected Mathematics 
Project: Year two evaluation. Retrieved from: http://tis.mpls. 
k12.mn.us/sites/5df1b159-7ce3-4aa3-8e71-8e60a7b98e6c/ 
uploads/connected_mathematics_2.pdf. Minneapolis, MN: 
Minneapolis Public Schools. The study does not meet WWC 
evidence standards because the intervention and comparison 
groups are not shown to be equivalent at baseline. 

Additional source: 

Winking, D. (2000a). Minneapolis data: Excerpts from the year 
two evaluation report. Connected Mathematics Project, 
East Lansing, Ml. 

Winking, D. (2000b). Minneapolis data: Excerpts from the year 
one evaluation report. Connected Mathematics Project, 

East Lansing, Ml. The study does not meet WWC evidence 
standards because the intervention and comparison groups 
are not shown to be equivalent at baseline. 

Woodward, J., & Brown, C. (2006). Meeting the curricular needs 
of academically low-achieving students in middle grade 
mathematics. The Journal of Special Education, 40(3), 151. 

The study does not meet WWC evidence standards because 
the measures of effectiveness cannot be attributed solely to 
the intervention— there was only one unit assigned to one or 
both conditions. 

Zawojewski, J. S., Robinson, M., & Hoover, M. (1999). Reflections 
on developing formal mathematics and the Connected Math- 
ematics Project. Mathematics Teaching in the Middle School, 
4(5), 324-330. The study is ineligible for review because it 
does not examine the effectiveness of an intervention. 

Zvoch, K., & Stevens, J. (2006). Longitudinal effects of school 
context and practice on middle school mathematics achieve- 
ment. The Journal of Educational Research, 99(6), 347-357. 
The study does not meet WWC evidence standards because 
the measures of effectiveness cannot be attributed solely to 
the intervention— the intervention was combined with another 
intervention. 



WWC Intervention Report Connected Mathematics Project (CMP) 



January 2010 



10 




Appendix 



Appendix A1 Study characteristics: Schneider, 2000 (quasi-experimental design) 



Characteristic 


Description 


Study citation 


Schneider, C. L. (2000). Connected Mathematics and the Texas Assessment of Academic Skills (Doctoral dissertation, University of Texas at Austin, 2000). Dissertation 
Abstracts International, 67(12), 4709A. (UMI No. 9997642) 


Participants 


The study included three cohorts from 23 CMP schools and 25 matched comparison schools overall. However, because baseline equivalence was established only for cohorts 
1 and 2 through 1998, the WWC excluded cohort 3 from this review. 1 Cohort 1 included more than 3,000 CMP students and 2,600 comparison students. Cohort 2 included 
more than 3,400 CMP students and 2,900 comparison students. 


Setting 


The participating schools were located in rural, suburban, and urban, as well as both low and high socioeconomic, areas of Texas. The schools varied in the English language 
learner status of the student populations that they served. Many of the schools had predominantly minority student populations. 


Intervention 


Schools in the treatment group used CMP, starting with grade 6 in 1996-97, adding grade 7 in 1997-98, and adding grade 8 in 1998-99. Cohorts in the school-level 
analysis represented all students in grades using CMP, regardless of whether the students were enrolled every year of implementation. By 1998, students in cohort 1 had 
received the intervention for up to two years (grades 6 and 7), and students in cohort 2 had received the intervention for one year (grade 6). There was substantial variation in 
the extent to which the curriculum was used at each grade level and each year across these schools. 


Comparison 


Schools in the comparison group did not use CMP. The author did not report the mathematics curricula used by comparison schools. The 25 comparison schools were 
matched to treatment schools using a regression analysis of variables that predicted 1996 Texas Assessment of Academic Skills (TAAS) passing rates. 


Primary outcomes 
and measurement 


The primary outcome measure included in this review was the school-level passing rate on the mathematics portion of the TAAS. For a more detailed description of this 
outcome measure, see Appendix A2. 


Staff/teacher training 


In the summer prior to implementation, teachers in the CMP schools participated in a six-day summer professional development provided by the Texas Statewide System 
Initiative. The training discussed units and emphasized mathematical understanding and pedagogy. Many teachers also participated in a two-day follow-up professional 
development in the summer after implementation. 



1. The author conducted both student-level and school-level analyses. However, baseline equivalence was established only for the school-level analysis. In addition, the sample of students for 
whom achievement scores were reported changed over time— special education students were included in 1999 achievement data but were excluded in prior years. Because baseline equiva- 
lence was established only for regular education students, the WWC excluded the 1 999 data from this review. This exclusion of the 1 999 data also resulted in the exclusion of cohort 3 because 
1999 is the only year for which posttest data were reported for cohort 3. 
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Appendix A2 Outcome measure for the math achievement domain 



Outcome measure 


Description 


Texas Assessment 
of Academic Skills 
(TAAS) pass rate 


The TAAS is a criterion-referenced test that measures problem-solving and critical-thinking skills. The measure used is the percentage of students that passed the math 
portion of the TAAS (as cited in Schneider, 2000). 
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Appendix A3 Summary of study findings included in the rating for the math achievement domain 1 









Author’s findings from the study 














Mean outcome 
(standard deviation) 2 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(schools/ 
students) 


CMP Comparison 

group group 


Mean 

difference 3 

(CMP 

- comparison) 


Statistical 

Effect significance 5 

size 4 (at a = 0.05) 


Improvement 

index 6 





Schneider, 2000 (quasi-experimental design) 7 








TAAS pass rate Grades6&7 96/>12,162 

(Cohorts 1 & 2) 7 


82% 8 of students 82% 9 of students 0.00 

(na) (na) 


0.00 


ns 


0 


Average for math achievement (Schneider, 2000) 9 




o.oo 10 


ns 


0 


Domain average for math achievement across all studies 9 




0.00 


na 


0 



ns = not statistically significant 
na = not applicable 

TAAS = Texas Assessment of Academic Skills 



1. This appendix reports findings considered for the effectiveness rating and the average improvement indices for the math achievement domain. Separate cohort findings from Schneider (2000) 
are not included in these ratings, but are reported in Appendix A4. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants 
had more similar outcomes. 

3. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

4. For an explanation of the effect size calculation, see WWC Procedures and Standards Handbook, Appendix B. 

5. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

6. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. 

The improvement index can take on values between -50 and +50, with positive numbers denoting results favorable to the intervention group. 

7. The WWC calculated a sample-weighted average of the cohort 1 and 2 effects to use in the intervention rating. Cohort 1 , the 7th grade cohort, had the intervention for two years and cohort 2, 

the 6th grade cohort, had the intervention for one year. Separate findings for cohorts 1 and 2 are reported in Appendix A4. 

8. The intervention group value from Schneider (2000) is the unadjusted comparison group mean plus the difference in mean gains between the intervention (CMP) and comparison groups. 

9. The comparison group mean from Schneider (2000) is unadjusted. 

10. The WWC used school-level pass rates to calculate the effect size because student-level pass rates were not available. In general, the school-level figures should serve as a reasonable approxi- 
mation of the individual figures if there are not large differences in pass rates between schools of substantially different enrollments. Based on prior pass rates (1996) provided by the author in 
the appendix, the WWC concluded that the pass rates computed using school-level data and student-level data were not substantially different. As a result, based on the available school-level 
pass rates, the WWC estimated that the mean difference of 0 percentage points resulted in an effect size of 0. 
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Appendix A4 Summary of cohort findings for the math achievement domain 1 



Author’s findings from the study 









Mean outcome 
(standard deviation) 2 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(schools/ 
students) 


CMP Comparison 

group 3 group 4 


Mean 

difference 5 

(CMP 

- comparison) 


Statistical 

Effect significance 7 

size 6 (at a = 0.05) 


Improvement 

index 8 



Schneider, 2000 (quasi-experimental design) 9 



TAAS pass rate 


Grade 7 


48/>5,701 


0.80 


0.80 


0.00 


0.00 


ns 


0 




(Cohort 1) 




(na) 


(na) 


(na) 








TAAS pass rate 


Grade 6 
(Cohort 2) 


48/>6,461 


0.84 

(na) 


0.83 

(na) 


0.01 

(na) 


0.06 


ns 


+2 



ns = not statistically significant 
na = not applicable 

TAAS = Texas Assessment of Academic Skills 



1. This appendix presents separate cohort findings for measures that fall in math achievement. A sample-weighted average of the cohort effects was used for rating purposes and is presented in 
Appendix A3. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants 
had more similar outcomes. 

3. The intervention group value from Schneider (2000) is the unadjusted comparison group mean plus the difference in mean gains between the intervention (CMP) and comparison groups. 

4. The comparison group mean from Schneider (2000) is unadjusted. 

5. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

6. For an explanation of the effect size calculation, see WWC Procedures and Standards Handbook, Appendix B. 

7. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

8. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. 

The improvement index can take on values between -50 and +50, with positive numbers denoting results favorable to the intervention group. 

9. The level of statistical significance was reported by the study authors or, when necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple 
comparisons. For an explanation about the clustering correction, see the WWC Tutorial on Mismatch. For the formulas the WWC used to calculate statistical significance, see WWC Procedures 
and Standards Handbook, Appendix C for clustering and WWC Procedures and Standards Handbook, Appendix D for multiple comparisons. In the case of Schneider (2000), no corrections for 
clustering or multiple comparisons were needed. 
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Appendix A5 CMP rating for the math achievement domain 

The WWC rates an intervention’s effects for a given outcome domain as positive, potentially positive, mixed, no discernible effects, potentially negative, or negative. 1 
For the outcome domain of math achievement, the WWC rated CMP as having no discernible effects. 



Rating received 

No discernible effects: No affirmative evidence of effects. 

• Criterion 1: None of the studies show a statistically significant or substantively important effect, either positive or negative. 

Met. None of the studies showed statistically significant or substantively important positive or negative effects. 

Other ratings considered 

Positive effects: Strong evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statistically significant positive effects, at least one of which met WWC evidence standards for a strong design. 

Not met. No studies showed statistically significant positive effects. 

AND 

• Criterion 2: No studies showing statistically significant or substantively important negative effects. 

Met. No studies showed statistically significant or substantively important negative effects. 

Potentially positive effects: Evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: At least one study showing a statistically significant or substantively important positive effect. 

Not met. No studies showed statistically significant or substantively important positive effects. 

AND 

• Criterion 2: No studies showing a statistically significant or substantively important negative effect and fewer or the same number of studies showing indeterminate 
effects than showing statistically significant or substantively important positive effects. 

Not met. The one study that evaluated math achievement and met WWC standards showed indeterminate effects. 

Mixed effects: Evidence of inconsistent effects as demonstrated through either of the following criteria. 

• Criterion 1: At least one study showing a statistically significant or substantively important positive effect, and at least one study showing a statistically significant 
or substantively important negative effect, but no more such studies than the number showing a statistically significant or substantively important positive effect. 

Not met. No studies showed statistically significant or substantively important effects, either positive or negative. 

OR 

• Criterion 2: At least one study showing a statistically significant or substantively important effect, and more studies showing an indeterminate effect than showing 
a statistically significant or substantively important effect. 

Not met. No studies showed statistically significant or substantively important effects, either positive or negative. 



1. For rating purposes, the WWC considers the statistical significance of individual outcomes and the domain-level effect. The WWC also considers the size of the domain-level effect for ratings of 
potentially positive or potentially negative effects. For a complete description, see the WWC Procedures and Standards Handbook, Appendix E. 
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Appendix A5 CMP rating for the math achievement domain (continued) 



Potentially negative effects: Evidence of a negative effect with no overriding contrary evidence. 

• Criterion 1: At least one study showing a statistically significant or substantively important negative effect. 

Not met. No studies showed statistically significant or substantively important negative effects. 

AND 

• Criterion 2: No studies showing a statistically significant or substantively important positive effect, or more studies showing statistically significant or substantively 
important negative effects than showing statistically significant or substantively important positive effects. 

Met. No studies showed statistically significant or substantively important positive effects. 

Negative effects: Strong evidence of a negative effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statistically significant negative effects, at least one of which met WWC evidence standards for a strong design. 

Not met. No studies showed statistically significant negative effects. 

AND 

• Criterion 2: No studies showing statistically significant or substantively important positive effects. 

Met. No studies showed statistically significant or substantively important positive effects. 
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Appendix A6 Extent of evidence by domain 



Outcome domain 


Number of studies 


Schools 


Sample size 


Students 


Extent of evidence 1 


Math achievement 


1 


96 




>1 2,1 62 2 


Small 



1. A rating of “medium to large” requires at least two studies and two schools across studies in one domain and a total sample size across studies of at least 350 students or 14 classrooms. Other- 
wise, the rating is “small.” For more details on the extent of evidence categorization, see the WWC Procedures and Standards Handbook, Appendix G. 

2. Schneider (2000) reported the number of students only for the student-level analysis. The student-level analysis included only students who were at the same school every year of implementa- 
tion, whereas the school-level analysis reviewed in this report includes all students in the schools, regardless of whether they were enrolled every year. The WWC used the number of students in 
the student-level analysis as the minimum for the number of students in the school-level analysis: 5,701 students in cohort 1 and 6,461 students in cohort 2. 
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